Virtual gaze redirection in face images
نویسندگان
چکیده
In video-conferencing, the participant watches the screen rather than the camera. This turns the gaze direction away from the other party and makes eye contact impossible. Artificial gaze redirection by iris repositioning was proposed, but the feasibility of crucial algorithmic components, especially the challenging computer vision parts, was not demonstrated. This paper demonstrates a system for gaze redirection in color face images via eye synthesis and replacement. The proposed method can serve as an image editing tool for entertainment and commercial use, and is an important step towards gaze-redirection in video-
منابع مشابه
Photorealistic Monocular Gaze Redirection Using Machine Learning.
We propose a general approach to the gaze redirection problem in images that utilizes machine learning. The idea is to learn to re-synthesize images by training on pairs of images with known disparities between gaze directions. We show that such learning-based re-synthesis can achieve convincing gaze redirection based on monocular input, and that the learned systems generalize well to people an...
متن کاملReal-time 3D Face Reconstruction and Gaze Tracking for Virtual Reality
With the rapid development of virtual reality (VR) technology, VR glasses, a.k.a. Head-Mounted Displays (HMDs) are widely available, allowing immersive 3D content to be viewed. A natural need for truly immersive VR is to allow bidirectional communication: the user should be able to interact with the virtual world using facial expressions and eye gaze, in addition to traditional means of interac...
متن کاملA New Method for Eye Detection in Color Images
The problem of eye detection in face images is very important for a large number of applications ranging from face recognition to gaze tracking. In this paper we propose a new algorithm for eyes detection. First, the face region is extracted from the image by skin-color information. Second, horizontal projection in image is used to approximate region of the eye be obtained . At last, the eye ce...
متن کاملA New Method for Eye Detection in Color Images
The problem of eye detection in face images is very important for a large number of applications ranging from face recognition to gaze tracking. In this paper we propose a new algorithm for eyes detection. First, the face region is extracted from the image by skin-color information. Second, horizontal projection in image is used to approximate region of the eye be obtained . At last, the eye ce...
متن کاملGazeDirector: Fully Articulated Eye Gaze Redirection in Video
We present GazeDirector, a new approach for eye gaze redirection that uses model-fitting. Our method first tracks the eyes by fitting a multi-part eye region model to video frames using analysis-by-synthesis, thereby recovering eye region shape, texture, pose, and gaze simultaneously. It then redirects gaze by 1) warping the eyelids from the original image using a model-derived flow field, and ...
متن کامل